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Abstract 

The problem of diagonalizing a class of complicated matrices, to be called ultrametric 
matrices, is investigated. These matrices appear at various stages in the description of 
disordered systems with many equilibrium phases by the technique of replica symmetry 
breaking. The residual symmetry, remaining after the breaking of permutation symmetry 
between replicas, allows us to bring all ultrametric matrices to a block diagonal form by 
a common similarity transformation. A large number of these blocks are, in fact, of size 
lxl, i.e. in a vast sector the transformation actually diagonalizes the matrix. In the other 
sectors we end up with blocks of size (R + 1) x (R + 1) where R is the number of replica 
symmetry breaking steps. These blocks cannot be further reduced without giving more 
information, in addition to ultrametric symmetry, about the matrix. Similar results for 
the inverse of a generic ultrametric matrix are also derived. 
PACS classification numbers: 75.10.Nr, 05.50.+q. 
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1. Introduction 



Low temperature disordered systems often possess many equilibrium phases. The 
technique of replica symmetry breaking (RSB) provides a theoretical framework in which 
these systems can be described analytically , starting from a microscopic basis. Discovered 
and developed in the theory of spin glasses [1] , RSB has recently penetrated into a number 
of other problems, including the theory of random manifolds [2-4] , random field problems 
[5,6], protein folding [7-9], vortex pinning [10], etc. In each of these theories randomness 
is handled via the replica trick, and the multitude of equilibrium phases is captured by 
breaking the permutation symmetry between the replicas. As always, symmetry breaking 
means that the low temperature solutions realize a particular subgroup of the underlying 
symmetry group of the theory, here of the permutation group. The proper choice of the 
subgroup proved to be a highly nontrivial task in the case of RSB. The succesful Ansatz 
for the symmetry breaking pattern, proposed by Parisi originally in the context of spin 
glasses, turned out to embody a particular, hierarchical organization of the equilibrium 
phases, usually referred to as ultrametricity [1]. 

The corresponding subgroup determines the structure not only of the order parameter, 
but also of all other quantities in the theory, like self-energies, propagators, etc. The 
structure imposed by this residual symmetry on quantities depending on two replica indices 
is by now widely known. The algebra of such quantities has been worked out by Parisi 
[11] with further results, most notably on the inversion problem, added by Mezard and 
Parisi [2]. At a certain stage of the development of RSB theories, however, one has to face 
also more complicated objects, depending on three or four replica indices. The structure 
of these is much harder to grasp and their algebra is much more involved than that of the 
two-index quantities. Our purpose here is to analyse and exploit the structure imposed by 
ultametricity on four-index quantities. For reasons to become clear shortly, we shall call 
them ultrametric matrices and will be concerned, in particular, with their diagonalisation 
and inversion. 

In order to keep the full generality of the results and thereby guarantee their applica- 
bility in any RSB theory, we shall not assume any properties other than those imposed by 
ultrametricity on these matrices. This way we separate the analysis of the purely geometric 
aspects of RSB theories, which are common to all of them, from the treatment of other 
properties which are determined by more specific details of the particular systems. 

Also, we shall keep the number n of replicas a positive integer throughout this paper. 
The replica limit n — > is, of course, the most essential step of the replica method. 
It is also the source of mathematical ambiguities. The analysis of the consequences of 
ultrametric symmetry, however, does not depend on n, therefore we found it useful to keep 
it finite. This way our analysis belongs to the realm of well-established mathematics and 
the analytic continuation in n can be carried out at the latest stage, on the final results. 

The number R of replica symmetry breaking steps will also be considered a generic 
integer. Thus our results will be applicable in situations where only a single RSB step 
is needed, as well as in the case of full-fledged RSB with R — > oo. The results for this 



"continuous" case (R — > oo, n — > 0), derived by a completely different method, will be 
published in [12]. 

Although almost trivial in principle, our analysis will, inevitably, be very complicated 
in actual details. It is clearly impossible to reproduce the often very lenghty calculations 
here, and we shall have to use the phrase " it can be shown" frequently. What we mean at 
these points is that one can reproduce the results easier than to follow the lengthy proofs. 
A good strategy is to work out a simple special case (like that with R = 1) first; the 
induction is easy to spot in most cases. 

The plan of the paper is the following: In Sec. 2 the definition of ultrametric matrices is 
presented together with the classification of their different matrix elements. Sec. 3 contains 
a detailed analysis of the non-orthogonal basis vectors of a similarity transformation that 
brings all ultrametric matrices to a block diagonal form. In Sec. 4 this block diagonal 
form is expressed through some "kernels", which facilitate the eigenvalue and inversion 
problem greatly. A complete list of matrix components versus kernels is also included in 
this section. Some technicalities are relegated to the Appendix. 

2. Definition of a generic ultrametric matrix 

For the sake of definiteness we present our analysis in the language of spin glasses, 
the extension to other replica symmetry breaking theories is merely a matter of notation. 
The replica method yields the free-energy F of a long-range spin glass in the form of a 
functional, depending on a set q a p of order parameters: F = F(q a p). The replica indices 
a, (3 take integer values: a, j3 = 1,2, ... ,n (for our present analysis the replica limit n — > 
need not be considered here). The order parameters are symmetric: q a p = qp a , and (for 
Ising spins) the diagonal components are zero: q aa = 0. The number of independent order 
parameter components is thus \n{n — 1). The free energy is independent of the labeling 
of the replicas, so F must be constructed from the algebraic invariants of the permutation 
group of n objects. Examples of such invariant combinations are: 

a/3 

J2 q ^ Trq4 > 

aft 

The stationary values of the order parameter components are determined by the equa- 
tion of state: ^ F = 0. There are |n(n — 1) such equations. Depending on the parameters 
in F these equations may have solutions that are indentically zero, q a p = 0, Va,/?, or 
that have non-zero but identical off-diagonal components q a p = q(l — S^a), or non-zero 
off-diagonal components that depend on the pair (a, j3) of replica indices. The solutions 
of the last kind are said to be replica symmetry breaking (RSB) solutions and these are 
the ones that describe situations where many equilibrium states exist. Led by a number 
of formal considerations that later turned out to embody the ultrametric organization of 
these states, Parisi proposed a, by now standard, parametrization for the RSB solutions 
which we briefly recapitulate in order to fix notations. 



Trq 2 = 22 lip Trq 3 = 22 QapqpjQja, 

a/3 a/37 
yiggggfrY' ^ QlffQa-yQ^ySgSa, etc. 



a/37 a{3j5 



Firstly assume that n is not only an integer, but a very large one, with a large number 
of proper divisors. Let p\ be one of these, itself a large number with many divisors, one 
of them p 2 , etc. up to pr. It is useful to rename n as po, and add Pr+i = 1 to the 
other end of the series. Now the n replicas are divided into njp\ boxes each containing p\ 
replicas. The contents of each box are further subdivided into p\jp2 smaller boxes with 
P2 replicas in each etc., down to the smallest boxes with pr replicas. The RSB solutions 
are supposed to be invariant w.r.t. the permutations of replicas inside each of the smallest 
boxes of size pr, and also w.r.t. the permutations of the size Pk+i boxes inside each of the 
size pk boxes for any k = 0, 1, . . . ,R— 1. Evidently, these permutations form a subgroup 
of the permutation group. This subgroup is the residual symmetry that remains after the 
breaking of replica symmetry. The Ansatz for the order parameter matrix corresponding 
to this residual symmetry is constructed as follows: The n x n (i.e. po x po) matrix q a p is 
divided into blocks of size p± xpi, and a common value qo is assigned to all matrix elements 
outside the diagonal blocks. Next the diagonal blocks are further divided into blocks of 
size p 2 xp 2 , the value qi assigned to the matrix elements inside the diagonal blocks of size 
Pi x pi but outside the diagonal blocks of size P2 x j?2, etc., down to the innermost blocks 
of size pn x pr, where the matrix elements are qR except along the very diagonal of the 
whole matrix where they are zero. Some formulae below (eqs. 32,34) become meaningless 
whenever the ratio of two subsequent p's is 2 or 3. These cases would require a separate 
discussion which we can safely omit here, since in practical applications these cases will 
never appear. For our present purposes we can stipulate Pk/Pk+i > 3, k = 0, 1, . . . , R. 

The solution of the stationary condition ^ F = is sought among the matrices which 

have the special form just described. This solution is a point in the ^n(n — l)-dimensional 
replica space, so it is, in fact, a vector. In the following, when we deal with genuine 
matrices acting on replica space, i.e. with quantities depending on two pairs of replica 
indices, we will actually call q a p and similar quantities vectors. The association between 
the n x n symmetric matrix q a p (with q aa = 0) and the column vector \q a p) is evident: 
one lists the matrix elements above the diagonal of q a p in any prescribed order (say, row 
by row) below each other. 

The representation of q a p and other vectors of replica space by symmetric matri- 
ces remains, nevertheless, very useful, because it is much easier to display their special 
structure in the matrix form. Therefore, we shall use this matrix representation for all 
vectors appearing in this paper. For later reference we note here that the scalar product 
of two vectors, \r a p) and \q a p), is, in matrix language, half the trace of the product of the 
corresponding matrices: 

{r a fi\q a p) = 7,Tr(rq). (1) 

We now introduce the concept of the overlap between replica indices that will play a 
central role in the following: the overlap between a and (3 is k (notation: a D (3 = k) if in 
the Parisi scheme q a p = qk- The overlap afl/5 defined this way can be regarded as a kind 
of hierarchical distance between replicas a and /3, its values ranging from (corresponding 
to the largest off-diagonal blocks of size p\ x pi) to R + 1 (corresponding to the diagonal, 
a = (3). 

It is evident that any quantity / constructed of the q's and depending on only two 



replica indices (such as f a p = ^qwyq^p, for example) depends only on their overlap: 

7 

/a/3 = /(an/5). 

The metric generated by the overlaps is, by construction, ultrametric: whichever way 
we choose three replicas a, 7, either all three of their overlaps are the same (a C\ (3 = 
a fl 7 = /3 fl 7) , or one (say a D (3) is larger than the other two, but then these are equal 

(a n /? > a n 7 = /3 n 7). 

Furthermore, it also follows that any quantity / built of the g's and depending on 
three replica indices, / a/ 3 7 , depends only on the overlaps a fl /?, a fl 7, /? fl 7, and since of 
these at most two can be different, / a /? 7 is, in fact, a function of only two variables, e.g. of 
a fl /5 and of the larger of the other two: 

/c3 T = /(anftmax{an7,/3n7}). (2) 

In the following we will also have to consider quantities depending on four replica 
indices, coming in two pairs: f a p,^s- A little reflection shows that such a quantity can 
always be parametrised as follows: 

/a/3, 7 <5 — J ma x{an7,an5},max{/3n7,/3n5} 

Admittedly, this parametrisation is less than perfect. Firstly, ultrametricity implies 
that of the six possible overlaps between a, /?, 7 and 5 at most three can be different, which 
corresponds to the simple geometric fact that the edges of a tetrahedron having equilateral 
or isosceles faces can have at most three different lengths. Therefore, of the four variables 
on the r.h.s. of (3) at least two are the same. The resulting redundancy is the price we 
pay for the symmetry of the notation. Secondly, in all practical applications f a p,-yS is 
symmetric w.r.t. exchanging a and (3 or 7 and 8 and also w.r.t. exchanging the two pairs: 
/a/3, 7(5 = /a/3,57 = //3q,7<5 = f-yS,a/3 etc., and these symmetries are not manifestly reflected 
by the parametrisation (3). We prefer keeping the consequences of these symmetries in 
mind rather than overcomplicating the notation. 

The choice between the various types of solutions of the equation of state (identically 
zero, or constant q a p, or replica symmetry broken q a p) is based on stability considerations. 
In order to decide the stability of a given solution, one has to diagonalize the Hessian or 
(bare) self-energy matrix dq d p Q q - = M a p^$, evaluated at the stationary point. M is 
the prime example of a quantity depending on two pairs of replica indices, so it can be 
parametrised as shown in (3). M is obviously symmetric w.r.t. the exchange of the two 
pairs (a/3) and (7^). Since q a p = qp a and q aa = 0, M can be considered to depend on the 
ordered pairs a < (3 and 7 < 6 only, so it is a matrix of dimension \n(n — 1) x \n[n — 1). 
A symmetric matrix of this size has, in general, \n{n — l)[|n(n — 1) + 1] independent 
elements. This number is greatly reduced by ultrametricity. Below we list all the different 
kinds of matrix elements that can appear. When doing so, we will relax the ordering of 
the indices of M a p tl s, and extend the definition to arbitrary combinations of the indices 
(except a = (3 and 7 = 5) such as to make M symmetric w.r.t. exchanging a and (3 
and/or 7 and 5, M a p^s = M a p^ = Mp a ^s = Mp a ^-y, in addition to the symmetry 
w.r.t. exchanging the pairs (a(3), (jS). This extension is motivated by convenience: when 



(3) 



summations are to be performed on the indices of M the restrictions due to ordering can 
become very cumbersome. 

The matrix elements can be classified naturally in three categories: 

(i) Matrix elements of the first kind. These are the diagonal elements M a/ 3 jQ( 3, to- 
gether with their variants M a p^ a , Mp a ^ a p, etc. They depend on the overlap a D f3 = 
i = 0, 1, 2, ... , R only. Under the parametrisation (3) they are given by 

M aM = M^ +ltR+1 i = 0,l,...,R. (4) 

There are, in general, R+l different matrix elements in this category (instead of ^n(n — 1), 
the dimension of the matrix). 

(ii) Matrix elements of the second kind. These are off-diagonal, with one replica index 
in common between the two pairs. One example is M a p j0lJ which, together with its ex- 
changed variants (M a p }lce etc.), exhausts all possibilities. 

There are three cases: 

(a) a H (3 = a n 7 = i < (3 n 7 = j = 0, 1, . . . , R. Then 

M aP , ai = M^ +lj , j>i. (5) 

Various exchanges of the replica indices either reproduce the same, or exchange the 
lower variables R+l and j. (The parametrisation (3) is such that is always 

symmetric in k and /.) 

(b) an / 3 = /3n7 = i<an7 = j. 

M a/3 , a7 = M^ +M , j>i. (6) 

Exchanging replica indices in all possible ways reproduces either the same, or ex- 
changes the lower variables, or exchanges i and j. Thus: 

M'iU, = Mi;i +1 = M% +1 . = , / < ,. (7) 

(c) anp = i>a(l'j = pn'j = j. 

M a/3 , Q7 = M£ J +1) . , i>j. 
According to (7), this is the same as (6) (rename % <-> j). 

It is easy to see that the number of different matrix elements is at most (R + l) 2 in 
this class. 

(iii) Matrix elements of the third kind. These have four different replica indices, 
Map^s- Considering all logically possible situations with a < (3, 7<5, ct<7, (3 < 5 
(corresponding to the matrix elements above the diagonal of M), we find six possible cases 
altogether. 

(a) a fl f3 = i, 7 D S = j, max{a n 7, a fl 6} = max{/3 fl 7, (3 n 6} = k with k < min{i, j}. 
Then 

M aP , l5 = = Mi% (8) 



where the second equality follows from exchanging the two pairs (a(3) <-> (7 5). 
(b) a fl P = i, 7 fl 6 = j, max{a fl 7, a fl 5} = maxj/? fl 7, f3 fl 5} = fc, j < k < i. Then 



M 0/9i7tf = Mft = Mg. (9) 

(c) a fl /5 = i, 7 fl 5 = j, max{a fl 7, a fl 5} = i, max{/3 fl 7, f3 fl 5} = fc, j < i < k. Then 

%^ = <i = M$ = Mj;*. (10) 

(d) a fl /3 = z, 7 fl 5 = j, max{a fl 7, a fl 5} = z, max{/3 fl 7, /3 fl 5} = fc, z < j < fc. Then 

aw=^=m£- ( u ) 

(e) a fl /3 = i, 7 fl 5 = j, maxja fl 7, a fl 5} = i, max{/3 fl 7, /3 fl 5} = k, i < k < j.Then 

M afl „6 = Mti = M^. (12) 

(f) a fl /5 = 7 fl 5 = i, max{a fl 7, a fl 5} = fe, max{/3 fl 7, /? fl 8} = I, i < min{/c, /}. Then 

M^s = Mi*. (13) 

In eqs. (8)-(13) the overlaps i,j,k,l can run through 0, 1, 2, . . . , R. Considering the cases 
(a)-(f) one can show that the number of different matrix elements of the third kind is 
(R+l) 3 . 

If all the |n(n — 1) independent order parameter components were different, the matrix 
M a/ 3 n s would have of order n 4 independent matrix elements. Parisi's RSB scheme does 
not completely destroy the permutation symmetry of the replicas, however, it only reduces 
this symmetry to a particular subgroup of the group of permutations of n elements. It is 
this residual symmetry that is responsible for the tremendous reduction in the number of 
independent elements of the Hessian: instead of (9(n 4 ) we have, according to eqs. (4)-(13), 
only 0(R 3 ) different matrix elements, which, for large n, is exponentially small compared 
to n 4 . 

The particular structure described above has been displayed in the example of the 
Hessian of the long-range spin glass. Matrices with an identical structure appear in many 
RSB theories. We shall call these matrices ultrametric matrices. From this point on we 
shall disregard the derivation and meaning of M, and will focus solely on its symmetries. It 
will be seen that these symmetries allow one to construct an irreducible representation for 
ultrametric matrices in that all those that have the same block sizes po,pi, . . . ,pr can be 
brought to a block diagonal form by the same similarity transformation and that no further 
reduction is possible without providing further information on the matrix elements. It will 
also be seen that the conditions ultrametricity imposes upon M are stringent enough to 
actually yield a large number of the eigenvalues in closed form. We shall also look into the 
problem of inversion of ultrametric matrices and shall find again that a large number of the 
components of the inverse can be obtained in closed form. Some of the results we compile 
here are not new, they were published by two of us some years ago in a very compact 
form [13]. In addition to rephrasing them and providing some background material we 



also present a number of new results, especially with regards to the inversion problem. 
As long as n is an integer with the sequence of divisors p±,P2, • • • ,Pr as described, the 
matrix M is a well-defined mathematical object, and the problem of its diagonalisation 
belongs to the realm of standard mathematics. The present paper will be concerned with 
this well-posed problem. At a certain point one will, however, have to consider the replica 
limit n — > 0, together with the analytic continuation in all the p^s and with the limit 
R — > oo, as proposed by Parisi [1]. These manipulations are at the present time of a purely 
formal character, certainly beyond the limits of well-established mathematics. After all 
these dubious steps one arrives at the problem of the diagonalisation of an integral operator 
with a set of particular symmetries. The results we get in the discrete case can all be easily 
transcribed on to this new, continuous problem. 



3. The new basis 



In the previous section the components of an ultrametric matrix M a p yl s have been 
given in the Cartesian coordinate system spanned by the basis vectors |/U,z/), (fx, v) = 
(1, 2), (1, 3), . . . , (n — 1, n), which, similarly to the order parameter q a p, can be represented 
by symmetric n x n matrices. Their matrix elements are 

I \ rKr -J 1 ' if fi = a,u = (3or n = (3 , v = a\ , 

\fr ")<*(> ~ V-),K/3) - \ o, otherwise. (Mj 

In order to bring M to a block diagonal form, we have to go over into a new basis. 
The new set of basis vectors can be inferred from the general structure of the eigenvectors 
described in [13] and, like those, can be naturally classified in three families. 

The first family 

The first family of basis vectors consists of R + 1 vectors labelled by i = 0, 1, . . . , R 
which, when represented by quadratic matrices, have identical nonzero elements on the i th 
level of the Parisi hierarchy and zeros everywhere else: 

\0;i)=(^n(pi-p i+1 )\ 2 \ a ^) ( 15 ) 

where the \a, /?)'s are the Cartesian unit vectors defined in (14). The meaning of the first 
label (0) will become clear shortly. 

The first family basis vectors form an (R + l)-dimensional orthonormal set in replica 
space. The difference pi — Pi+i in the normalisation factor will appear so often in the 
following that it is worth giving it a name: 

Pi-Pi+i=Si , i = 0, 1, . . .,R. (16) 

A straightforward but tedious calculation shows that the subspace spanned by the 
first family basis vectors is closed under the action of an ultrametric matrix. Therefore 
the linear combination 

l/> = X>W|0;i> ( 17 ) 

i=0 



is an eigenvector of M, provided the amplitudes fo(i) are appropriately chosen. The con- 
ditions for these amplitudes (i.e. the eigenvalue equations) will be written up in the next 
section. Evidently, there will be R + 1 possible choices for the amplitudes, corresponding 
to R + 1 eigenvalues A m (0), m = 0, 1, . . . , R. In the case of a generic matrix M with 
no symmetries other than those dictated by ultrametricity, all these eigenvalues will be 
singlets, their multiplicity /i(0) = 1, and the eigenvectors orthogonal. In the following we 
shall often refer to the first family as the longitudinal or L family. 

The second family 

The second family will be broken down into several subfamilies, to be labelled by an 
index k = 1, 2, . . . , R + 1. The first family is, in several respects, nothing but the case 
corresponding to k = 0, which is why we used the label in addition to i. The structure of 
the second family basis vectors is easiest to grasp graphically, so we define them in a series 
of figures. The vectors belonging to the k = 1 subfamily are shown in Figs. 1,2. (Although, 
as we have already mentioned, the ratios of subsequent p's must never be 2 or 3, in order 
to prevent the figures from occupying an excessive space, here and in almost all the figures 
to follow we have to illustrate the structure of eigenvectors by figures where some of these 
ratios are 3.) Consider the vectors shown in Fig. 1. They have nonzero components only 
on the zeroth level of the Parisi hierarchy, but now not all these components are identical: 
they take two different values, A and B, arranged as shown in the figure. We shall denote 
these vectors as |1; 0; b), where the first label is the value of k, the second is that level of the 
Parisi hierarchy where the vector has nonzero elements, and the third, b = 1,2,..., n/pi, 
shows which column and row of blocks is distinguished, i.e. which blocks have matrix 
elements B. 

p, n 







B 






A 









Fig. 1: The vectors \k = l,i = 0,6). The label b = 1, 2, . . . , n/p\ shows which column 
and row of pi x pi blocks is distinguished. Identical shading means identical components. 
Blank means zero. 



Now consider the sum of these vectors, J2b=i 1 1 ; 0; 6) . The distinction between the 
different blocks will obviously disappear in the sum, so it will be proportional to |0; 0) of 
the first family. However, we want to make each of the second family vectors orthogonal 
to the first family, so we have to choose the vector components, A and B so as to make 
the above sum vanish. If we choose, say, A = 1 then B must be 

(18) 



With this choice the |1; 0; 6) vectors are all orthogonal to the first family and 



n/pi 

^|1;0;6> = 0. (19) 

6=1 

The evident symmetry between these vectors makes it obvious that they pairwise make 
the same angle which, together with (19), means that they span an (^- — 1) -dimensional 
hypertetrahedron. It also follows that there is no further linear relationship between them, 
so if we discard one, say |1; 0;n/pi), we will be left with 

Ml)=nfl-1) (20) 
\Pi PoJ 

linearly independent basis vectors. These will not be normalised, nor orthogonal, however. 
It would be an easy task to construct an orthonormal set out of them, but it would destroy 
their symmetry. We find it slightly more convenient to work with a biorthogonal set. For 
the same reason we need not worry about normalisation. It is an elementary exercise to 
show that the set 

' !i ^|i ;0 ;6)-|l;0;-)V 6=1,2,...,--!, (21) 



n z (n - 2pi) V Pi J Pi 



is biorthogonal to the set |1; 0; 6). 

We now proceed, still within the k = 1 subfamily, to the next level of the Parisi 
hierarchy. The vectors \k=l;i= 1;6) are shown in Fig. 2. 




i i fh 

Fig. 2.: The basis vectors |1; 1;6). 



Similarly to the previous case, orthogonality to the first family vector |0; 1) demands 



n/pi 



b=i 



which is satisfied if the vector components are chosen as 



A = l, 




(22) 



Then the vectors |1; 1; b) span a / u(l)-dimensional hypertetrahedron again, with the asso- 
ciated biorthogonal set 



The construction proceeds along similar lines: filling in the i level of the Parisi hierarchy 
we find the same //(l)-dimensional tetrahedra with the same orthogonality conditions (22) 
applying for any i > 1 (only the case i = 0, eq. (18), is different). This way we will have, 
altogether, fi(l) (R + 1) independent basis vectors 



making up the k = 1 subfamily. They are each orthogonal to the first family, two of them 
belonging to different values of i are also orthogonal, but two such vectors with the same 
i and different 6's are not. 

It can now be shown again that the subspace spanned by the R + 1 vectors |1; i; b), 
i = 0, 1, . . . , R, for b fixed is an invariant subspace of an arbitrary ultrametric matrix. 
Therefore the linear combination 



with appropriately chosen amplitudes f± (i) , independent of 6, will be an eigenvector. There 
will be R+l choices for these amplitudes, yielding R+l eigenvalues Ai(m), m = 0, 1, . . . , R, 
in the k = 1 subfamily. Each of these will be / u(l)-fold degenerate, according to the free 
choice of b. 




(23) 



l;i;6), 



i = 0, 1,...,R and 6 = 1,2,..., 1, 

Pi 



R 



/> = E/i( < )|i;i;6> 



i=0 



We now turn to the k = 2 subfamily . Some of the k = 2 type vectors with the i = 
Parisi level filled are shown in Fig. 3. 




etc. 



etc. 



Fig. 3: Some vectors of the k = 2 subfamily (i = 0). 

These vectors will be labelled as |2; 0; a, 6) where a = 1, 2, ... , n/pi shows which column 
of pi x pi sized blocks has nonzero elements and b = 1,2,... ,p\jp2 shows which column 
of p2 x p 2 sized blocks is distinguished inside column a. The sum |2;0;a,6) must 

vanish again for any fixed a, otherwise it would be a linear combination of k = and k = 1 
subfamily type vectors. This orthogonality condition demands that we choose 

A = 1, S = 1 - ^ (24) 

leaving P1/P2 — 1 independent vectors (spanning a tetrahedron again) for any fixed a. It 
is easy to see that with this choice the vectors |2;0;a, 6) will not only be orthogonal to 
each of the previous families (with k = 0, 1) but they will also be orthogonal to the vectors 
|2; 0; a', b') with a ^ a' and any b' . 

Some fe = 2, i = 1 vectors are shown in Fig. 4. 
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Fig. 4.: Some vectors of the k = 2 subfamily (i = 1). 



The orthogonality conditions now read 

We can go on to build |2; i; a, 6), z = 0, 1, . . . , R in a similar manner. The subspace of these 
vectors for fixed a and b will be closed under the action of an ultrametric matrix M. Thus 

R 

i=0 

will be an eigenvector with R + 1 choices for the amplitudes and with eigenvalues A2(m), 
m = 0, 1, . . . , R. We have seen that for a given a we have |^ — 1 linearly independent 
choices for the basis vectors, while for different a's they are already orthogonal. That 

means we have — ( — — 1 ) , i.e. 

fJL (2) = n(---) 

\P2 PlJ 

independent basis vectors for any i. The total dimension of the k = 2 subfamily is thus 
(j,(2) (R+ 1), and the multiplicity of the k = 2 eigenvalues is //(2). 

The generalisation is now obvious. In the k th subfamily (k = 1, 2, . . . , R + 1) we have 
vectors labelled by four indices: |fc;i;a, 6). This vector has nonzero elements only on the 



Pk-l 



i th level of the Parisi hierarchy, and there only inside one column and row of blocks of size 
Pk-i x Pk-i- There are n/pk-i such columns, and the label a = 1, 2, . . . , n/pk-i shows 
which is the one in question. The vector components inside these blocks are all l's, except 
inside a distinguished column and row of blocks of size pk x pu where they are * 

B= 1 -(2-^), if i = k-l 

2 V Pk J 

V Pk / (25) 

B = 1 — Pk 1 , otherwise. 

Pk 

The distinguished columns oipk ><Pk blocks are labelled by the last index, 6=1,2,..., 

Pk 

With the choice (25) the vectors \k; i; a, b) are orthogonal to all the previous subfamilies 
with k— 1, k— 2, . . . etc. down to the first family. Within the k th subfamily vectors belonging 
to different i's and a's are also orthogonal, while those with a fixed k, i, a and different 
6's make a — 1) -dimensional hypertetrahedron. The number of linearly independent 

vectors for a given k and i will then be — ( — 1 ) , i.e. 

° Pk-l \ Pk /' 

IM(k) = n(--—). (26) 
\p k Pk-i J 

The biorthogonal set associated with the tetrahedral groups of vectors belonging to a given 
triplet k, i, a is 

\k;i;a,b) = ( \k; i; a, b) - \k; i; a, ^^-) j (27) 

Pk-i g\ \ Pk J 

(k) 

where the weight g\ is defined as 

Pi-p i+1 , i<k-l 
g W= \ J(p fc _i-2p fc ), i = k-l (28) 

§(p*-Pi+i)» i>k-l. 

For fixed fc, a, 6 the i? + 1 vectors |fc; z; a, 6), z = 0, 1, . . . , R, form an invariant subspace of 
any ultrametric matrix, so we will have eigenvectors of the form 

R 

J2fk(i)\k;i;a,b) (29) 

with amplitudes fk(i) independent of a, b. The corresponding eigenvalue equations will give 
R+l possible values for fk(i), and the eigenvalues X m (k), m = 0, 1, . . . , R, will be //(fc)-fold 
degenerate. Sometimes the second family is also called the anomalous or A family. 



* We take the opportunity to correct a misprint in eq. 4 in [13] here. The B for i = k — 1 
was given as B = \ [l — ^f^j there instead of the correct expression in (25). 



So far from the \n{n — l)-dimensional replica space we have split off the (R + 1)- 
dimensional invariant subspace of the first family, the (R + 1) -dimensional subspaces, fj,(l) 
in number, of the k = 1 subfamily, etc., up to k = R + 1, that is we have decomposed our 
linear space into 

R+l 

^ = n 

k=0 

(R + l)-dimensional invariant subspaces plus the vast space, of dimension \n{n — 1) — 
n(R + 1), orthogonal to the first and second families. 

The third family 

The third family, often called the replicon or R family, comprises everything remain- 
ing after splitting off the first two families. It is a most remarkable fact, and a direct 
consequence of the stringent conditions ultrametricity imposes upon a matrix, that the 
third family can be decomposed into invariant subspaces of dimension 1, i.e. directly into 
eigenvectors. This also means that the third family eigenvalues that, for large n, represent 
the overwhelming majority of all the eigenvalues can be obtained in closed form, in terms 
of the matrix elements, for any ultrametric matrix. 

The third family eigenvectors were given in a concise form in [13]. We provide a little 
more detail here which will become important when we invert the matrix M. 

The third family consists of several subfamilies labelled by three integers 

r = 0,l,...,R 
k,l = r + l,r + 2,...,R+l. 

There will be several degenerate vectors in each subfamily. They will be labelled by three, 
five, or seven more indices, as the need arises. A common property of all third family 
vectors is that they have nonzero components only inside one single diagonal block of 
size p r xp n which also gives the significance of the label r above. The labels k and / 
specify further structural details that are best displayed on a series of figures again. In the 
following we shall exhibit only that p r x p r -sized block over which the vector components 
are not all zero. 

The r, k = r + 1, I = r + 1 subfamily 

The structure of the nonvanishing block is shown in Fig. 5. These vectors take three 
further labels to specify them |r; r + 1, r + 1; a, 6, c). The index a = 1, 2, ... , n/p r shows 
which of the n/p r diagonal p r x p r blocks has nonvanishing elements. Inside this block 
all the components belonging to the diagonal p r +i x p r+ i blocks vanish again. Of the 
off-diagonal p r +i x p r +i blocks those belonging to two columns and rows are distinguished 
and a further distinction is made between the blocks at the crossing of a distinguished 
column and row and the rest. The indices 6, c = 1, 2, . . . ,p r /p r+ i, b ^ c, label the two 
distinguished columns. In all, we then have three different vector components in this 
subfamily, as shown in the figure. 




Fig. 5.: The third family vector |r; r + 1, r + 1; a, 6, c). Identical shading means identical 
components, blank means zero, b = 1, c = 3 in the figure. 



Orthogonality to the previous families requires that 

p r /p r+1 

|r; r + 1, r + 1; a, b, c) = 

6=1 

b^c 



(31) 

|r; r + 1, r + 1; a, 6, c) = 0. 



c=l 



It follows from (31) that the sum of vector components in each row should vanish, giving us 
two equations for the three numbers A, B, C, the third being determined by normalization. 
They work out to be: 

Pr+l A 



B = 



Pr ~ 2Pr+l 



C =l o v 1 q S A ( 32 ) 

(p r - 2p r+1 ) [Pr - 3p r+ l ) 
p r - 3p r +l 



Pi +1 (Pr ~ Pr+l) 



With this we have determined the eigenvectors with r, r + l,r + 1 completely. The cor- 
responding eigenvalues will be written up in the next section. For a given position of the 

p r x p r block, i.e. for a given a, the orthogonality conditions (31) leave — 

vectors linearly independent. This number, multiplied by — , the number of choices for a, 

Pr 

gives the multiplicity of this class: 



1 p r - 3p r +l 

- n o — 

2 P 2 r+ 1 



H(r;r + l,r + l) = -n 2 Fr+ \ r = 0,l,...,R. (33) 



Eigenvectors with r, k > r + 1, I = r + 1 
An example is shown in Fig. 6. 
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Fig. 6.: An eigenvector of the class \r; k > r + 2, 1 = r + 1; a, b, c, d, e). 



Such a vector is constructed as follows. One chooses a diagonal block of size p r xp r , 
labelled by a = 1,2, ... ,n/p r , as before. Inside this block one chooses two columns and 
rows of blocks of size p r +i x Pr+i, say the 6 th and the c th , such that c>6(6=l,c = 2in 
Fig. 6). Inside the blocks in the 6 th column and row one now chooses a strip of blocks of 
size Pk-i x Pk-i, say the d th , as shown in the figure. All the vector components outside 
this strip will be zero. Inside the strip one chooses a strip, the e th , of blocks of size PkXPk- 
Finally the vector components A, B, C, D are arranged, as shown, according to whether 
they belong to the strip of width pj~ or are outside, and also whether they belong to the 
c th blocks or not. 

Orthogonality to previous families again requires, as throughout the third family, that 
the sum of components in each row vanish. This immediately gives 

B = — A 



Pk-i ~Pk 
C = Pr+1 A 

Pr - 2Pr+l 



D = PkPr+1 A ^ 



A 



2 



(p fe _l -p k )(Pr ~ 2p r+ l) 
Pr - 2p r+1 ( 1 1 



Pr+1 (Pr - Pr+1 ) \Pk Pk-1 



for the components of a normalised vector of this class. 

Considering the various choices for the parameters a, 6, c, d, e one finds that the total 
number of linearly independent vectors of this kind is 

H(r; k, r + 1) = I n Pr - 2Pr+1 (- —J, k = r + 2, r + 3, . . . , R + 1. (35) 

2 p r+1 \p k Pk-i J 



The subfamily r;/c = r + l,/>r + lis obtained by the same construction but with 
c < b; this subfamily will be similar to the r; k > r+ 1, 1 = r + 1 subfamily in every respect, 
but it will be orthogonal to it. 

Eigenvectors with r, k > r + 1, I > r + 1 

The construction of these vectors is shown in Fig. 7. It begins again by choosing one 
diagonal block of size p r x p r , labelled by a. This can be done in n/p r different ways. 
Next, inside this block one chooses two symmetrically positioned off diagonal blocks of 
size Pr+i x Pr+i. This takes two indices: 6, c = 1, 2, . . . ,p r /p r+ i, and the number of inde- 
pendent choices is h ( — 1 ) , because of the symmetry of the matrix representing 



2 p r+ i \^p r+ i 

the eigenvector. Now the off diagonal p r +i x Pr+i block above the diagonal is cut into 
rectangles of horizontal size pi-i and vertical size Pk-i and the one below the diagonal is 
cut similarly with the horizontal and vertical dimensions exchanged. 


























Pi 


p 



Pk 



'1-1 



B 



D 



(a) (b) (c) 

Fig. 7.: The construction of an eigenvector with r,k > r + 1,1 > r + 1. The structure of 
the vector is shown in three stages of finer and finer resolution. The block with indices c, b 
in (a) is obtained by reflection to the diagonal from block 6, c. 



One of these rectangles is chosen, which again takes two labels: d = 1, 2, . . . ,p r+ i/p/_i, 
and e = 1, 2, . . . ,p r+ i/pk-i, and can be done in Pr +1 /(pi-iPk-i) ways. We have nonzero 
components only inside these rectangles. Their structure is shown in Fig. 7(c), and 
can evidently be characterised by two further indices / = 1, 2, . . . ,pi_i/pi, and g = 
1, 2, . . . ,Pk-i/pk- These vectors are orthogonal to each other in all the indices except 
for / and g. For fixed / the set with different g's forms the usual tetrahedron again, and 



■VI- 

) * \ 

choices for / and g. All these taken together give a multiplicity 



the same is true for fixed g in the /'s, so we are left with { 1 — 1) x (^p — 1) independent 



MnM) = \n{p r -Pr+i) (- — J ( — — J , k,l = r + 2,r + 3,...,R+l, 

2 \p k Pk-i J \Pi Pi-i ) 

(36) 

while the usual orthogonality conditions (the sum of vector components in each row and 
each column vanishes) give us the following values for the components of a normalised 



vector of the r, k > r + 1,1 > r + 1 type: 



B 



C 



Pi-i ~Pi 



Pk-i ~Pk 




(37) 
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(p fc _i -pfc)(pj_i - pi) 
/ 1 1 \ / 1 




1 



Pk 



Pk-i 



Pi 



Pi-i 



With this we have given a full description of the third family eigenvectors. To show 
that these forms are indeed reproduced under the action of an ultrametric matrix takes, 
of course, a lot of algebra. It is impossible for us to go into details on this, but we think 
a little experimentation in a simple special case like R = 1 will convince the reader that 
the proof is quite straightforward though certainly not very short. As we have seen, there 
is a high degree of degeneracy within each subfamily (r;k,l). These subfamilies are all 
orthogonal to each other (and also to the first and second families, of course), and some 
of the degenerate vectors within a given (r; k, I) subfamily are also orthogonal, but some 
form the by now familiar tetrahedral sets in more than one index. It would not be difficult 
to orthogonalise these vectors, or, alternatively, to construct biorthogonal sets to them. 
We refrain from doing both: the loss in symmetry would be considerable and the gain 
virtually nothing. The only occasion when we might need a properly orthonormalised set 
is when later we construct the "replicon" components of the inverse of M from the spectral 
resolution. It will turn out, however, that the orthogonalisation can be circumvented even 
there and the ultrametric symmetries of M (and of its inverse) will allow us to deduce 
the full contribution of the whole (r; k, I) subfamily to the inverse from the knowledge of a 
single vector belonging to that subfamily. This vector will be called the representative 
vector of the subfamily. 

We can choose any of the fi(r; k, I) degenerate vectors to be the representative vector. 
Suppose we have made our choice. Some of the vectors in the (r; k, I) subfamily will be 
orthogonal to the selected vector from the beginning. These will, as a rule, have zero 
components where the selected vector has nonzero ones, in particular, they will have zeros 
where the components we called A's in the description of the third family vectors, i.e. those 
in the darkest shaded areas in the figures, are to be found in the selected vector. Now 
consider the vectors which are not orthogonal to the selected one. In order to orthogonalise 
them to the representative vector we form some linear combinations. Our key observation 
is now that, due to the defining properties of the third family vectors (namely, that the 
sums of vector components in each row are zero) , any linear combination that is orthogonal 
to the representative vector will have zero components where the representative vector has 
its components A. The proof of this will also be left as an exercise to the reader. 

The last issue to be settled in this section is the total multiplicity of our basis vectors. 
In the first two families we found n(R+ 1) independent basis vectors. In the subfamilies 



(r; k, /), for fixed r, there are a total of 



R+l 



-n(p r -p r+1 - 2) 



(38) 



independent vectors. This summed over r gives the total number of basis vectors in the 
third family: 



Added to n (R + 1) this gives \n(n — 1), the dimension of replica space. Our set of basis 
vectors is therefore complete. 

4. The block diagonal form of ultrametric matrices 

Having constructed a complete set of basis vectors we can build a matrix S with 
columns made of these vectors and transform M to this new basis by 



S is not an orthogonal transformation (because the basis vectors are not all orthogonal), 
so M will not be symmetric. The rows of the inverse S 1-1 in the first family sector will 
be made of the bra vectors corresponding to the first-family-like basis vectors |0;i), in 
the second family sector they will be the biorthogonal vectors given in (27). In the third 
family sector we do not really need to construct the matrix S~ x at all, since there the 
basis vectors are the eigenvectors themselves. Since the various families and subfamilies 
were constructed in such a way that they are invariant subspaces of M, the transformed 
matrix M will have a block diagonal form: along the diagonal we will have a string of n 
(R+l) x (R + l) matrices, the first corresponding to the first family, the next //(l) identical 
matrices corresponding to the k = 1 subfamily in the second family, etc. through fx(k) 
identical blocks for the k th subfamily up to k = R + 1. This string of matrices will be 
followed by the string of the third family eigenvalues coming in groups of fi(r; k, I) identical 
numbers corresponding to the subfamilies (r;k,l). 

The third family or replicon eigenvalues are obtained as a byproduct of checking that 
the third family vectors given in the previous section are eigenvectors indeed. In the (r; k, I) 
subfamily one obtains the closed expression 




(39) 



M = S~ L MS. 



(40) 



R+l R+l 



A(r; k, I) = Y Ps E Pt(M% - M t-i,s - MZ_, + M^) 



s=fc t=l 



(41) 



r = 0, 1,...,R 
k,l = r + l,r + 2,...,R+l, 



giving the replicon eigenvalues directly in terms of the matrix elements and of the p's 
characterising the structure of M. Eq. (41) has been written up already in [13]. 



The (R + 1) x (R + 1) diagonal blocks of M will be labelled by k = 0, 1, . . . , R + 1 
as M^ k \ k = corresponding to the first family, k > to the subfamilies in the second 
family. The matrix elements of can be obtained by sandwiching M between two first 
family vectors 

M$ = (0;r|M|0;s), (42) 

those of ilf( fc ) by sandwiching M between a second family vector and one from the biorthog- 
onal set given in (27): 

M {k ] = (kfna, b\M\k; s; a, b) (43) 

and can really be obtained again as byproducts when verifying the invariance of the various 
subfamilies under the action of the matrix M. 
We can therefore simply state the result: 

M ? = A fc, r)5 r K s r + <,<*> A —fj -^ fc (r, s . (44) 

d r d s 



Of the symbols appearing here 8 r and have already been defined in (16) and (28), 

fKr 
J r,s 



respectively. 5^1 is the Kronecker symbol, while A?' is 



|<y r , r < k - 1 

A< fc) = <j I(4-i -p fc ), r = fc-l (45) 

5 r , r > — 1. 

The diagonal part A(k, r) is related to the third family eigenvalues: 

[K ' T) \ A(r;r + l,r + l), k < r + 1. 1 DJ 

Now we define the kernel K k (r, s) appearing in (44) : 

Wr,s) = \± Pj (M; : ;-M^ hj _ l) + 1 - ± pWS-kU) 



j=k j=r+l 
R+l 

+ E Pi(K'j-K'j-i)> k-l<r<s, 

j=s+l 

\K k (s,r) = \± Pj (M; : J-M; L \ J _ 1 ) + l ± Pj (M% - Mfr^) 

j=k j=r+l 
R+l 

+ E PiiKJ - Kj-i), k-l<r<s, 

j=8+l 



(47) 



(48) 



\ Kk {r, s) = IY^pAK]- - Kj-i) + E PiWj' - K'j-i), r < k - 1 < a, (49) 

j=k j—8+1 
, 1 s R+l 

^(s, r) = - J2pAM;;J - U]"\, ) + £ Pj( M % ~ r<k-l<s, (50) 

j—k j=8+\ 
, R+l 

l K k (r 1 8) = Y t p j (^j-^j_ 1 ) 1 r<s<k-l, (51) 

j=k 

^ fc ( S ,r) = X;p J (M;;;-M^_ 1 ), r< a <fc-l. (52) 

j=k 

(Possible empty sums here and in the following are understood to be zero. For k = 0, 
terms with M r _^l _ x may occur in the above formulae. They are, by definition, zero too.) 

(k) 

With this the matrix elements Mr, J in the new representation have been expressed 
in terms of the matrix elements in the original representation. The problem of finding 
the eigenvalues of M in the first two families has thus been broken down into the prob- 
lem of finding the spectrum of each of the M^'s. As we have already noted, due to 
the nonorthogonality of the transformation S, the M^'s are not symmetric. Using the 
symmetries between the various components of M as described in Sec. 2, one can show, 
however, that, although we have given the expressions for both K k (r,s) and Kk(s,r) in 
the various cases for completeness, the kernel K k is, in fact, symmetric. Therefore, the 
asymmetry of is carried solely by the factor in eq. (44), and we can, if we wish, 
reduce the eigenvalue problem of to that of the manifestly symmetric matrix 



(fc) 

(fc)3 lvl r,s ( k )h 

9s 



Let us now spell out the eigenvalue equation of M^: 

E M r5 ) /*(«) = A(fc)/ fc (r) 

s=0 

reads in the two cases r < k — 1 and r > k — 1, respectively, as 

A(k,r)f k (r) + j Yl K k (r,s)f k (s)5 s + l(5 k - 1 -p k )K k (r,k-l)f k (k-l) 



4 ^ g 

s=0 
s^k-1 



X(k)f k (r), r<k-l 



A(k,r)f k (r) + l K k (r,s)f k (s)S a + \(S k - 1 -p k )K k (r,k-l)f k (k-l) 



(53) 



2 

s=0 
s^k-1 



A(fc)/ fc (r), r>k-l. 



This is a set of R + 1 homogeneous linear equations for any given k = 0,1, . . . , R+ 1. (In 
the first family, i.e. for k = 0, only the equation with r > k — 1 applies, with the third 
term on the l.h.s. discarded.) The solutions for the f k s give the amplitudes mentioned in 
the preceding section, while the A(/c)'s are the corresponding eigenvalues. 

It is evident from the definition that the space of ultrametric matrices (belonging 
to the same series po,Pi, ■ ■ ■ ,Pr) is closed under addition. That it is also closed under 
multiplication is easiest to see from the existence of the common similarity transformation 
S that brings any two such matrices to blockdiagonal form simultaneously. 

Suppose we are given two ultrametric matrices M and M' , with the associated kernels 
K k and K' k and replicon eigenvalues X R and X R from which we have the corresponding 
A's as given in (46). Then in the block diagonal representation of the product MM' we 
will find for the diagonal blocks in the LA sector: 

t=o ° r ° s 

\ Y, A ( t k) K k (r, t)K' k {t, s) + A(k, r)K' k (r, s) + A'(k, s)K k {r, s) \ (54) 

+ 5^ s A(k,r)A'(k,r) 
where we have used that by (16), (28), (45) 



St S 2 - 2 ^< . (M) 



whereas in the R sector we will evidently find the product of the replicon eigenvalues: 

\{r-k,l)\\r-k,l). (56) 

In particular, if M' is the inverse of M, we have Yl t M t s = S^l and A(k, r)A'(k, r) = 
1, so from (54) we get 



1 R 



L - £ Af ] K k (r, t)K' k (t, s) + A(k, r)K' k (r, s) + A'(k, s)K k {r, s) = 0. (57) 



2 



i=0 



For a given M, i.e. for a given K k and A(k, r), this is an equation for the kernel K' k of the 
inverse matrix. In the general case (57) is still a matrix equation which is typically difficult 
to solve, though (57) certainly has the merit of reducing the problem of the inversion of 
a ^n(n — 1) x ^n(n — 1) dimensional matrix to that of inverting R + 2 much smaller 
matrices (corresponding k = 0, 1, . . . , R + 1 in (57)) of size (R + 1) x (R + 1). In some 
important special cases, however, further progress can be made and both the solution of 



the eigenvalue equations (53) and the inversion of the matrix M can be carried through 
to the end [12]. 

Coming back to eq. (57) let us assume now that we have somehow succeeded in solving 
it for K' k . With this the inversion of M is, however, not yet completed, because normally we 
need the inverse in the original Cartesian coordinate system, i.e. we need the components 
of M' given the kernel K' k . This means we have to invert the formulae (47)- (52), or, to 
put it even more simply, we have to turn (40) around like 

M = SMS' 1 . (58) 

In the LA sector this is a standard operation: we have all the basis vectors and 
their biorthogonal counterparts so that we explicitly know the corresponding blocks in S 
and S -1 . This is not the case in the R sector where we have neither orthogonalised nor 
biorthogonalised our basis vectors. In the direct transformation, from M to M, this did 
not cause a problem, because the third family basis vectors being eigenvectors we knew 
in advance that the corresponding "blocks" of M would be the eigenvalues themselves. In 
the inverse transformation, from M to M, however, we would definitely need the missing 
blocks in in order to determine the contribution of the replicon family to the various 
components of M. It is at this point that the concept of the representative vector intro- 
duced in the previous section becomes important. We do not think we should dwell upon 
how the blocks of the three matrices in (58) have to be multiplied in the sector where 
they are known. We have to explain, however, how the replicon contribution to (58) can 
be obtained from the representative vectors without actually knowing the corresponding 
block in S -1 . The Appendix is devoted to this problem. 

In what follows we will state our results for the nine different types of matrix elements 
of M discussed in Sec. 2, in terms of the matrix elements of the blockdiagonal form M. In 
each case we shall give the result in two different forms: first as a sum of two terms, one 
coming from the LA sector, the other from the replicon, and second, in a form where some 
most remarkable cancellations between these two have been effected. In the discrete case, 
where n, R, and all the p^s are integers, these cancellations may seem coincidental. We 
note, however, that in the continuous limit they acquire a fundamental importance [13]. 

In order to display these cancellations we partition the third family multiplicities as 
follows: 

n(r; k, I) = /U re g(r; k, I) + /U s i n g(r; k, I) (59) 



where 



^ eg (r; r + 1, r + 1) = \n^- (— - —) , (60) 

2 p r+1 \p r+1 p r J 



r+1 



/Wsin g (r;r+ l,r + 1) = -J^^(fe), (61) 

k=0 

/Ure g (r-;r + l,k) = ^ reg (r; k, r + 1) = \n— — ( — ) , 

1 Pr+l \Pk Pk-1 J 



(62) 
k>r + l, 



l^ 8 in S (r;r + l,k) = ii sing (r;k,r+l) = ~ii(k), k>r + l (63) 
and /U reg (^; k, I) for k, I > r + 1 is the full fi(r; k, I) itself, as given in (36), so 

A*sin g (r; k, I) = 0, fc,Z>r + l. (64) 

In (61) and (63) //(/c) is the second family multiplicity. In the discrete case the sub- 
scripts "regular" and "singular" have no particular significance; in the continuous limit, 
however, fx s i ng will be associated with terms that become meaningless but disappear from 
the theory due to the cancellations mentioned above. 

We now list the results: 

= E + E E 2j ^Mr; k, I) (65.) 

fc=0 r k=r+ll=r+l r 

where the first term is the LA, the second the R contribution as announced. Substituting 
(44) for M^ k > and splitting \x as \x = /j reg + /U sing we see that the A(fc, r) term coming 
from the LA cancels the // s ing contributions from the R family exactly. So we have the 
alternative form: 



k=r+l l=r+l '"~ r 



«K W . = E ^ k>K '^ r >+ E E *. 0- (656) 

Similarly: 

fc=0 



fc=r+l Z=r+1 

£— — 

— 1 — 1 °" , (r: 1 - n ;/ xi/ ; a(/) 

n5 r 



+ E E M "V ; k, ;)(^- + %— 1 , (>r . (666) 



fc=r+l Z=r+1 

In the special case t = r of the above, things work out slightly differently: 

M r ' r - 

m R+l,r - 

2//(fc) A r - z p k -iQ r ,k-i M ( k ) 



h 



t *r-5Pfc-l^_i 



Pr+i (2/i(r;r + l,r + 1) 

<^ A(r;r + l,r+l) 

2p r+ i L no r 



+ E Mr:r , + 1 ' k) Hr;r + l,k)} (67a) 

fc=r+2 r 

= E # ; "^-'^-' ^'^(r.r), (676) 

^ nS r 8 r - 5Pfc-l<Jg_! 

so that, as we see, the A term coming from the LA now cancels the whole replicon contri- 
bution, not just the one with /Using- 

The next item to be considered is a component of M with different upper indices, so 
that there is no replicon contribution to it: 



(fc) 



— n <L<L ,S k) 

k=o r s 9s 

R+1 „(k) A (fe) A (fc) 
n d r d s 

fe=0 



Now we turn to the matrix elements of the third kind: 



fc=0 



= ^(^l 2 ^-- 1 )' (69) 



n 

A:=0 



Note that this holds even for r = s, because 



R+i / A (fc) 
E^) 2-^-1) =0, 



therefore the diagonal part A in never contributes. Neither does the replicon, because 
the upper indices are larger than the lower ones in here. 

The next four items are off-diagonal in the upper indices, so they do not receive 
contributions from the replicon family. 



u = fro " *• { * " 7 «P> 

= E^(^-ljMr. S ). .< t <r, (70) 



M "=E „ ^ W . {- 5, -\ 



Afff 

(fc) 



= E^^(^-1)^, S ), r<.<«, (Tl) 



n \ 5 r 



k=o " \ " r / 9s 



(72) 



fc=0 



fc=o n " r V Us J 9s 

^ m A?> ( A?> \ , N 



(73) 



In the next two cases again a complete cancellation takes place between the A term 
in the LA and the replicon: 

2//(r;r + l,r + l) 2^ 

+ r 7 o v 5 rA(r;r+l,r + l) (74a) 

nb r {p r - 2p r+1 ) (p r - 3p r +l ) 



2,i(fc) - jPk-iS^ ( A 



M r ' r 

±v± r,s 



R+l 

p r+ i j- 2/n(r;r + l,r + l) 
2p r+ i I no" r 



(fc) 



(fc) 



+ 



R+l 

+ E 

fc=r+2 



5 r 5 S 

A(r;r+ l,r + l) 



- 1 



2/i(r; r + 1, k) 
nd r 



\{r;r+l,k) 



A { r k) 5 s + A ( s k) 5 r - 5 r 5 s 



R+l 



= E 



(fc) 



A«o s 



+ 



1 ^fc(r,r) 



(75a) 
s > r. (756) 



Finally, in the last type of component the A term from the LA cancels the /U s i ng term 
in the R: 



_ ™ 2n{k) ( 

fc=0 r \ s 



(k) A (k) 



n5 r 

k=r+ll=r+l 




As we have mentioned, in the equations from (65) to (76) the formulae denoted (a) 
give the true partition of the contributions between the LA and R families. If anyone 
tried to reproduce these results, they would inevitably get them in this form, and we give 
them here partly as signposts. In most applications the origin of the terms is completely 
immaterial, however, so that when using these formulae, one will clearly apply the (b) 
forms, where the cancellations have been performed. The names one attaches to these 
terms are also largely a matter of convention: in the papers [14] and [15] where analogous 
formulae were derived for the propagators two of us used the name LA for the first terms 
and the name R for the second terms in the (b) forms. 

We also see that there is nothing mysterious about the cancellations: the diagonal ma- 
trix elements of M^ k ' contain the replicon eigenvalue and this piece partially or completely 
cancels the contribution from the R family. In [13] two of us, discussing the importance 
of these cancellations in the context of the propagators, made the remark that a certain 
asymptotic relation between the second family and third family eigenvalues was a neces- 
sary condition for the cancellations to work. Although the asymptotic relation between 
the eigenvalues was certainly valid in the specific example discussed there, and may be 
valid in more general situations also, we can clearly see that it has nothing to do with the 
cancellations: these are a purely "kinematic" effect, depending solely on the ultrametric 
geometry and on no further details of the theory. 

To conclude, we make an additional remark. Before presenting formulae (65)-(76) we 
gave a sketchy indication (with some details to be added in the Appendix) as to how they 
can be obtained, which is, of course, not necessarily the most economic way that they can 
be verified once known. Eqs. (65)-(76) are the inversion of (47)-(52) and of (41). The 
simplest way to check them is by direct substitution. 

Having established the inverse relations between the matrix elements and the kernel 
we can now summarise the steps one has to follow in order to invert an ultrametric matrix. 
First one has to determine the kernel and the replicon eigenvalues of the matrix by (41), 
(47)-(52). To get the replicon eigenvalues of the inverse matrix is trivial, they are the re- 
ciprocal of the original replicon eigenvalues. To obtain the new kernel requires the solution 
of (57). This is the hard core that remains to be cracked after the layer controlled by 



ultrametricity has been peeled off. To find the new kernel requires the concrete knowledge 
of the matrix elements and as such it is outside the scope of the present paper. Assuming 
the new kernel has been found one finally obtains the elements of the inverse matrix via 
eqs. (65)-(76). 
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Appendix 

Our purpose here is to sketch the derivation of the replicon contributions to Eqs. 
(65-76) through what we called the representative vector. 

Eq. (58), written out in the original, Cartesian coordinates, reads: 

M a ^ 5 = J^iamMijijhS) (A.l) 

ij 

where \i) now means any of the \n{n — 1) new basis vectors, and \j) are their biorthogonal 
counterparts. 

We are interested here in the contribution of the replicon family to (A.l) only, i.e. in 
the partial sum, to be denoted by M^^g, where i and j are restricted to the replicon 

sector. But M is diagonal in that sector, Mij = A^^j", so we have 

M& 7tf = 5>fli>M57*>. (A.2) 
ieR 



Now let aC\(3 = r. Then the replicon vectors \i) contributing to (A. 2) have to be such that 
they have nonzero components on the r th level of the Parisi hierarchy. From the description 
of these vectors given in the main text we know, however, that their components on every 
other level are then identically zero, and furthermore even on the r th level their nonzero 
components are concentrated inside a single block of size p r xp r . Evidently, the component 
(ck/3) must belong to this block. Although we have not actually determined the biorthogonal 

set (i| (and our purpose here is to show that we do not need to, either), it is obvious that 

(i\ will share the above properties of it will have nonzero components on the r th level, 
and there inside the same p r x p r block only. It follows that (■yd) must belong to the same 
block and an(3 = ^nd = r. 

With this we have identified the set of replicon vectors that, for a given a, /?, 7, 5, 
can give a nonzero contribution to s . This set can be decomposed into orthogonal 

classes, labelled by the triplet of integers r, k, I (fc, I > r + 1), as explained in Sec. 3. In a 
given class (r, k, I) we still have several nonorthogonal replicon vectors and, in principle, 
they all contribute to (A. 2). What we wish to show is that, in fact, one can choose a single 
vector from each class (r, fc, /) in such a way as to exhaust the contribution of the whole 
class. We have called this vector the representative vector of the class. 

The choice of the representative vector is not unique. It is best to choose it such that 
the component (jS) belong to the "darkest" block, where the vector has the components 
A. (Consult Figs. 5,6,7.) Now, as we have already pointed out in Sec. 3, the subspace 
orthogonal to the representative vector thus chosen is spanned by vectors that have zero 
components over this "A-block". In particular, if |r; fc, /) is the representative vector of the 
class (r, k, I) then the biorthogonal counterparts of all the other members of the class will 
lie in the space orthogonal to \r; k, /), hence their components in the " A-block" where also 
the pair (7$) resides must necessarily be zero and thus their scalar product with the unit 
vector |7<5) will vanish. Therefore, the only contribution from the class (r, fc, /) comes from 
the representative vector, indeed. 

The summation in (A. 2) then runs over the representative vectors only, so we can 
rewrite (A. 2) as 

R+l R+l 

M ^s= E E A(r;M)W?|r;M>(r;M|7<5>- (A3) 

k=r+l l=r+l 

We now decompose (r;k,l\ into components parallel and orthogonal to \r;k,l). The or- 
thogonal component will not contribute to (A. 3) for the same reasons as above. So we 

are left with the parallel component only, which, in view of (r; k,l\r; k,l) = 1 and of the 
normalisation of \r; k,l), is nothing but the representative vector itself. So we can finally 
write 

R+l R+l 

M a^s= E E A(r;M)Mr;M><r;Ml7*>- (^4) 

k=r+l l=r+l 

Although the above consideration is quite trivial really, one may find it mystifying 
that it is possible to reconstruct a matrix from selecting a single vector from each class of 



its eigenvectors which are nonorthogonal within the class. As it transpires from the proof, 
the key factor is that the subspace orthogonal to the representative vector is composed 
of vectors having vanishing components over the " A-block" , and this in turn hinges upon 
the common property of all replicons, namely that the sum of their components in each 
row is zero. A little more reflection will show one, however, that the underlying reason is 
that the matrix s does not depend on a, (3, 7 and 5 separately, only on the various 

overlaps formed out of these indices, therefore the puzzling property of the representative 
vectors carrying all the information about M R can be directly linked to the ultrametric 
symmetries of M. 

As an illustration of the use of (A. 4), let us calculate the diagonal components M^p aj3 . 
There will be three kinds of terms contributing to (A. 4): 

(i) fc = Z = r + l: 

(r;r + l.r + I\af3) =A =— — - = , (A.5) 

Pr+lVPr ~ Pr+l) ™r 

where use has been made of Eqs. (32), (33). 

(ii) k > r + 2, I = r + 1: 

(r;k,r + l\aPf = A"= * - 2Pr+1 . ( — - —) = Mr;k r + 1) 



Pr+l(Pr ~ Pr+l) \Pk Pk-1 J TlS. 



where we have used (34) and (35). 
(hi) k > r + 2J > r + 2: 

\p k Pk-i J \Pi P1-1J nb r 

see (36), (37). 

Substituting (A.5), (A. 6) and (A.7) back into (A.4) we find 

k=r+l l=r+l r 



which is precisely the second (replicon) term quoted in (65a). The replicon contributions 
to (66a), (67a), (74a), (75a) and (76a) can be worked out similarly. 



